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(57) Abstract: A network processor that has multiple processing elements, each supporting multiple simultaneous program threads 
with access to shared resources in an interface. Packet data is received from high-speed ports in segments and each segment is 
assigned to one of the program threads. Each packet may be assigned to a single program thread, two program threads - one for 
header segment processing and the other for handling payload segment(s) - or a different program thread for segment of data in a 
packet. Dedicated inputs for ready status and sequence numbers provide assistance needed for receiving the packet data over a high 
speed port. The dedicated inputs are used to monitor ready flags from the high speed ports on a cycle-by-cycle basis. The sequence 
numbers are used by the assigned threads to maintain ordering of segments within a packet, as well as to order the writes of the 
complete packets to transmit queues. 



WO 01/50679 A3 I HBi tlilllll It Illltf HUE UI! I II fli IHN lllll Illfl lllll IHI llilllf llll IDE llll 



Pu blish ed : For two-letter codes and other abbreviations, refer to the "Guid- 

— with international search report once Notes on Codes and Abbreviations " appearing at the begin- 

ning of each regular issue of the PCT Gazette. 

(88) Dale of publication of the international search report: 

17 January 2002 



INTERNATIONAL SEARCH REPORT 



tr itionai Application No 

Ptf/US 00/33405 



A. CLASSIFICATION OF SUBJECT MATTER - 

IPC 7 H04L12/56 H04L12/44 



According lo International Patent Classification (IPC) or lo both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (dassilcalion system followed by classification symbols) 
IPC 7 H04L 



Documentation searched other than minimum documentation lo the extent that such documents are included in the fields searched 



Electronic dala base consulted during the international search (name of data base and. where practical, search terms used) 

EPO-Internal , WPI Data, PAJ 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category " Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to daim No. 



US 5 173 897 A (PFEIFFER BODO 
22 December 1992 (1992-12-22) 



ET AL) 



I- 4,25, 
26 

7-10 
5,6, 

II- 24,27 



abstract 










column 


2, 


line 


49 - 


line 


57 


column 


3, 


1 ine 


25 - 


line 


31 


column 


3, 


line 


34 - 


line 


44 


column 


4, 


line 


17 - 


line 


20 


column 


4, 


line 


58 - 


line 


61 


column 


5, 


1 ine 


35 - 


line 


44 


claim 


1 











-/- 



m 



Further documents are fisted in the continual ion of box C. 



Patent family members are fisted in annex. 



• Special categories ot cited documents : 

•A' document defining the general slate of the an which is not 

considered to be of particular relevance 
•E" earlier document but published on or after the international 

filing date 

V document which may throw doubts on priority daim(s) or 
which is cited to establish the publication date of another 
dtalion or other spedal reason (as specified) 

•O* document referring to an oral disdosure. use. exhibition or 
other means 

a p* document published prior to the international filing date but 
later than the priority dale claimed 



*T' later document published after the international tiling date 
or priority date and not in conflict with the application but 
dted to understand the prindple or theory underlying the 
invention 

'X* document of particular retevance: the daimed invention 
cannoi be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

*Y* document of particular relevance; the daimed invention 

cannoi be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

*&* document member of the same patent family 



Dale of the actual completion ot the international search 

16 July 2001 


Dale ol mailing of the international search report 

23/07/2001 


Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL-2280HV Rijswijk 
TeL (+31-70) 340-2040. Tx. 31 651 epo nl, 
Fax: (+31-70) 340-3016 


Authorized officer 

Lai, C 



Form PCT71SA/210 (second sheet) (July 1992) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



In' tional Application No 

PC l /US 00/33405 



C.(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 


Category J 


Citation ot document, with indication. where appropriate, ol the relevant passages 


Relevant to claim No. 


Y 


IIC C Q7Q Q7Q A ( PAP/ UrHMPUl 11 FT Al ^ 


7 — 1 O 




2 November 1999 (1999-11-02) 




A 




14,24 




abstract 






column 1, line 14 - line 16 






column 2, line 65 -column 3, line 14 






column 4, line 24 - line 28 






column 8, line 60 - line oo 






claim o 




X 


EP 0 633 678 A (BELL TELEPHONE MFG) 


1-4,25, 




11 January 1995 (1995-01-11) 


26 . 


A 




5-13,27 




abstract 






page 1, column 1 -column 15 






page 3, line 15 - line 24 






page 6, line 2 - line 11 






claim 1 






- 











Form PCT/ISA/210 (cwitinualion ot saoond sheet) (July 1992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 



Information on patent family members 


In' itional Application No 

PCI /US 00/33405 


Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 



US 5173897 



22-12-1992 



DE 
AT 
AU 
AU 
CA 
CA 
DE 
EP 
ES 
JP 
JP 
KR 



3942977 
136706 
639961 
6786890 
2032774 
2032774 
59010278 
0435046 
2088944 
2898762 B 
6209328 A 
163180 B 



27-06- 
15-04- 
12-08- 
27-06- 
01-02- 
24-06- 
15-05- 
03-07- 

01- 10- 

02- 06- 
26-07- 
01-12- 



1991 
1996 
1993 
1991 
1994 
1991 
1996 
1991 
1996 
1999 
1994 
1998 



US 5978838 



02-11-1999 



US 
JP 
KR 
CN 
DE 
FR 
JP 



6058465 A 

10149341 A 

267091 B 

1180864 A 

19735350 A 

2752630 A 

10134036 A 



02-05-2000 
02-06-1998 
01-11-2000 
06-05-1998 
12-03-1998 
27-02-1998 
22-05-1998 



EP 0633678 A 11-01-1995 AU 677840 B 08-05-1997 

AU 6479494 A 12-01-1995 

CA 2126916 A 30-12-1994 

DE 69329059 D 24-08-2000 

DE 69329059 T 22-03-2001 

ES 2148197 T 16-10-2000 

US 5548593 A 20-08-1996 



Form PCT71SA/210 (patent family annex) (July 19&3) 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 



iiiiiiiiiiiuiiiiiiiiiiiiniiniiDiiii 



(43) International Publication Date 

12 July 2001 (12.07.2001) PCT 



(10) International Publication Number 

WO 01/50247 A2 



(51) International Patent Classification 7 : G06F 9/00 

(21) International Application Number PCT/USOO/34537 

(22) International Filing Date: 

19 December 2000 (19.12.2000) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 
09/479377 



5 January 2000 (05.01.2000) US 



(63) Related by continuation (CON) or continuation-in-part 
(C1P) to earlier application: 

US 09/479377 (CON) 

Filed on 5 January 2000 (05.01.2000) 

(71) Applicant (for all designated States except US): INTEL 
CORPORATION [US/US]; 2200 Mission College Boule- 
vard, Santa Clara, CA 95052 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): WOLRICH, 
Gilbert [US/US]; 4 Cider Mill Road. Framingham, MA 
01701 (US). ADILETTA, Matthew, J. [US/USJ; 20 Mon- 
ticello Drive, Worcester, MA 01603 (US). WHEELER, 
William [US/US]; 9 Darlene Drive, Southborough, MA 



01772 (US). CUTTER, Daniel [US/US]; 14 Walnut 
Street, Townsend, MA 01469 (US). BERNSTEIN, Debra 
[US/US]; 443 Peakham Road, Sudbury, MA 01776 (US). 

(74) Agent: HARRIS, Scott, C; Fish & Richardson P.C.. Suite 
500, 4350 La JoUa Village Drive, San Diego, CA 92122 
(US). 

(81) Designated States (national): AE. AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 
DE, DK, DM, DZ, EE, ES, FI, GB, GD, GE, GH, GM, HR, 
HU, ID, IL, IN. IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, 
NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL. TJ, TM, 
TR, TT, TZ, UA, UG, US, UZ. VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ. TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF. BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

Published: 

— Without international search report and to be republished 
upon receipt of that report. 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations " appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



= (54) Title: MEMORY SHARED BETWEEN PROCESSING THREADS 



ID. 



pa bus 



24a ~ 



76- 



< 

© 



O 



16a 

SDRAM 



Mbus[63.D} 



SRAM 



SRbus(31:0J 



FLASHROM 



38-. 



Memory Unit 

Fbus/PCt/AMBA 



AD[31:0J 



PCIBusLJNF. 
andCSRs 



26*^ 



SRAM Unit 
Fbus/AMBA 



Z2SL 



-24 



,32 



y^-30 



PROCESSOR 
Core 



rbus 
Interface 
RfJFlFOs 
Scratch 

CSRs 



^28 



34 



18- 




26C 



^223 



(57) Abstract: A method includes 
pushing a datum onto a stack by 
a first processor and popping tbe 
datum off the stack by a second 
processor. 



13a- 



} FBUS[63tif { 



10/100 BaseT 
Octal MAC 



Gigabit 
Ethernet 



-13t> 



WO 01/50247 



PCT/US00/34537 



MEMORY SHARED BETWEEN PROCESSING THREADS 
BACKGROUND 

The invention relates to memory shared between 
processing threads. 

A computer thread is a sequence or stream of 
computer instructions that performs a task. A computer 
thread is associated with a set of resources or a 
context . 

SUMMARY 

In one general aspect of the invention, a method 
includes pushing a datum onto a stack by a first 
processor and popping the datum off the stack by the 
second processor. 

Advantages and other features of the invention will 
become apparent from the following description and from 
the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram of a system employing a 

hardware-based multi- threaded processor. 

FIG. 2 is a block diagram of a MicroEngine employed 

in the hardware -based multi -threaded processor of FIG. 1. 
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FIG. 3 is a block diagram showing instruction sets 
of two threads that are executed on the MicroEngines of 
FIGS. 1 and 2. 

FIG. 4 is a simplified block diagram of the system 
5 of FIG. 1 showing selected sub-systems of the processor 

including a stack module. 

FIG. 5A is a block diagram showing the memory 
components of the stack module of FIG. 4. 

FIG. 5B is a block diagram showing the memory 
10 components of an alternate implementation of the stack 

module of FIG. 4 . 

FIG. 6A is a flow chart of the process of popping a 
datum from the memory components of FIG. 5A. 

FIG. 6B is a block diagram showing the memory 
15 components of FIG. 5A after the popping process of FIG. 

6A. 

FIG. 7A is a flow chart of the process of pushing a 
datum on the memory components of FIG. 6B. 

Fig. 7B is a block diagram showing the memory 
20 components of FIG. 6B after the pushing process of FIG. 

7A. 

FIG. 8 is a block diagram showing memory components 
used to implement two stacks in one stack module. 



DETAILED DESCRIPTION 
25 Referring to FIG. 1, a system 10 includes a 

parallel, hardware -based multithreaded processor 12. The 
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hardware -based multithreaded processor 12 is coupled to a 
bus 14, a memory system 16 and a second bus 18. The bus 
14 complies with the Peripheral Component Interconnect 
Interface, revision 2.1, issued June 1, 1995 (PCI) . The 
system 10 is especially useful for tasks that can be 
broken into parallel subtasks or functions. Specifically 
hardware-based multithreaded processor 12 is useful for 
tasks that are bandwidth oriented rather than latency 
oriented. The hardware-based multithreaded processor 12 
has multiple MicroEngines 22 each with multiple hardware 
controlled threads that can be simultaneously active and 
independently work on a task. 

The hardware-based multithreaded processor 12 
also includes a central controller 20 that assists in 
loading microcode control for other resources of the 
hardware -based multithreaded processor 12 and performs 
other general -purpose computer type functions such as 
handling protocols, exceptions, and extra support for 
packet processing where the MicroEngines pass the packets 
off for more detailed processing such as in boundary 
conditions. In one embodiment, the processor 20 is a 
StrongArm (TM) (StrongArm is a trademark of ARM Limited, 
United Kingdom) based architecture. The general -purpose 
microprocessor 20 has an operating system. Through the 
operating system, the processor 20 can call functions to 
operate on MicroEngines 22a-22f . The processor 20 can 
use any supported operating system preferably a real time 
operating system. For* the core processor implemented as 
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a StrongArm architecture, operating systems such as, 
Microsoft NT real-time, and VXWorks and /xC/OS, a freeware 
operating system available over the Internet at 
http : / /www. ucos-ii . com/ , can be used. 

The hardware-based multithreaded processor 12 
also includes a plurality of functional MicroEngines 22a- 
22f. Functional MicroEngines (MicroEngines) 22a-22f each 
maintain a plurality of program counters in hardware and 
states associated with the program counters. 
Effectively, a corresponding plurality of sets of threads 
can be simultaneously active on each of the MicroEngines 
22a-22f while only one is actually operating at any one 
time. 

In one embodiment, there are six MicroEngines 
22a-22f as shown. Each MicroEngines 22a-22f has 
capabilities for processing four hardware threads. The 
six MicroEngines 22a- 22f operate with shared resources 
including memory system 16 and bus interfaces 24 and 28. 
The memory system 16 includes a Synchronous Dynamic 
Random Access Memory (SDRAM) controller 26a and a Static 
Random Access Memory (SRAM) controller 26b. SDRAM memory 
16a and SDRAM controller 26a are typically used for 
processing large volumes of data, e.g. , processing of 
network payloads from network packets. The SRAM 
controller 26b and SRAM memory 16b are used in a 
networking implementation for low latency, fast access 
tasks, e.g., accessing look-up tables, memory for the 
core processor 20, and so forth. 
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The six MicroEngines 22a-22f access either the 
SDRAM 16a or SRAM 16b based on characteristics of the 
data. Thus, low latency, low bandwidth data is stored in 
and fetched from SRAM, whereas higher bandwidth data for 
which latency is not as important, is stored in and 
fetched from SDRAM. The MicroEngines 22a-22f can execute 
memory reference instructions to either the SDRAM 
controller 26a or SRAM controller 16b. 

Advantages of hardware multithreading can be 
explained by SRAM or SDRAM memory accesses. As an 
example, an SRAM access requested by a Thread_0, from a 
MicroEngine, will cause the SRAM controller 26b to 
initiate an access to the SRAM memory 16b. The SRAM 
controller controls arbitration for the SRAM bus, 
accesses the SRAM 16b, fetches the data from the SRAM 
16b, and returns data to a requesting MicroEngine 22a- 
22b. During an SRAM access, if the MicroEngine e.g., 22a 
had only a single thread that could operate, that 
MicroEngine would be dormant until data was returned from 
the SRAM. By employing hardware context swapping within 
each of the MicroEngines 22a-22f , the hardware context 
swapping enables other contexts with unique program 
counters to execute in that same MicroEngine. Thus, 
another thread e.g., Thread_l can function while the 
first thread, e.g., Thread_0, is awaiting the read data 
to return. During execution, Thread_l may access the 
SDRAM memory 16a. While Thread_l operates on the SDRAM 
unit, and Thread_0 is operating on the SRAM unit, a new 
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thread, e.g., Thread_2 can now operate in the MicroEngine 
22a. Thread_2 can operate for a certain amount of time 
until it needs to access memory or perform some other 
long latency operation, such as making an access to a bus 
interface. Therefore, simultaneously, the processor 12 
can have a bus operation, SRAM operation and SDRAM 
operation all being completed or operated upon by one 
MicroEngine 22a and have one more thread available to 
process more work in the data path. 

The hardware context swapping also synchronizes 
completion of tasks. For example, two threads could hit 
the same shared resource e.g., SRAM. Each one of these 
separate functional units, e.g., the FBUS interface 28, 
the SRAM controller 26a, and the SDRAM controller 26b, 
when they complete a requested task from one of the 
MicroEngine thread contexts reports back a flag signaling 
completion of an operation. When the MicroEngine 
receives the flag, the MicroEngine can determine which 
thread to turn on. 

One example of an application for the hardware - 
based multithreaded processor 12 is as a network 
processor. As a network processor, the hardware -based 
multithreaded processor 12 interfaces to network devices 
such as a media access controller device e.g., a 
10/100BaseT Octal MAC 13a or a Gigabit Ethernet device 
13b. The Gigabit Ethernet device 13b complies with the 
IEEE 802. 3z standard, approved in June 1998. In general, 
as a network processor, the hardware-based multithreaded 
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processor 12 can interface to any type of communication 
device or interface that receives/sends large amounts of 
data. Communication system 10 functioning in a 
networking application could receive a plurality of 
network packets from the devices 13a, 13b and process 
those packets in a parallel manner. With the hardware - 
based multithreaded processor 12, each network packet can 
be independently processed. 

Another example for use of processor 12 is a 
print engine for a postscript processor or as a processor 
for a storage subsystem, i.e., RAID disk storage. A 
further use is as a matching engine. In the securities 
industry for example, the advent of electronic trading 
requires the use of electronic matching engines to match 
orders between buyers and sellers. These and other 
parallel types of tasks can be accomplished on the system 
10. 

The processor 12 includes a bus interface 28 
that couples the processor to the second bus 18 . Bus 
interface 28 in one embodiment couples the processor 12 
to the so-called FBUS 18 (FIFO bus) . The FBUS interface 
28 is responsible for controlling and interfacing the 
processor 12 to the FBUS 18. The FBUS 18 is a 64 -bit 
wide FIFO bus, used to interface to Media Access 
Controller (MAC) devices. 

The processor 12 includes a second interface 
e.g., a PCI bus interface 24 that couples other system 
components that reside on the PCI 14 bus to the processor 
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12. The PCI bus interface 24, provides a high-speed data 
path 24a to memory 16 e.g., the SDRAM memory 16a. 
Through that path data can be moved quickly from the 
SDRAM 16a through the PCI bus 14, via direct memory 
access (DMA) transfers. The hardware based multithreaded 
processor 12 supports image transfers. The hardware 
based multithreaded processor 12 can employ a plurality 
of DMA channels so if one target of a DMA transfer is 
busy, another one of the DMA channels can take over the 
PCI bus to deliver information to another target to 
maintain high processor 12 efficiency. Additionally, the 
PCI bus interface 24 supports target and master 
operations. Target operations are operations where slave 
devices on bus 14 access SDRAMs through reads and writes 
that are serviced as a slave to target operation. In 
master operations, the processor core 20 sends data 
directly to or receives data directly from the PCI 
interface 24. 

Each of the functional units is coupled to one 
or more internal buses. As described below, the internal 
buses are dual, 32 bit buses (i.e., one bus for read and 
one for write) . The hardware -based multithreaded 
processor 12 also is constructed such that the sum of the 
bandwidths of the internal buses in the processor 12 
exceeds the bandwidth of external buses coupled to the 
processor 12. The processor 12 includes an internal core 
processor bus 32, e.g., an ASB bus (Advanced System Bus) 
that couples the processor core 20 to the memory 
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controller 26a, 26c and to an ASB translator 30 described 
below. The ASB bus is a subset of the so-called AMBA bus 
that is used with the Strong Arm processor core . The 
processor 12 also includes a private bus 34 that couples 
the MicroEngine units to SRAM controller 26b, ASB 
translator 30 and FBUS interface 28. A memory bus 38 
couples the memory controller 26a, 26b to the bus 
interfaces 24 and 28 and memory system 16 including 
flashrom 16c used for boot operations and so forth. 

Referring to FIG. 2, an exemplary one of the 
MicroEngines 22a-22f, e.g., MicroEngine 22f is shown. 
The MicroEngine includes a control store 70, which, in 
one implementation, includes a RAM of here 1,024 words of 
32 bit. The RAM stores a microprogram. The microprogram 
is loadable by the core processor 20. The MicroEngine 
22f also includes controller logic 72. The controller 
logic includes an instruction decoder 73 and program 
counter (PC) units 72a- 72d. The four micro program 
counters 72a- 72d are maintained in hardware. The 
MicroEngine 22f also includes context event switching 
logic 74. Context event logic 74 receives messages 
(e.g., SEQ_#_EVENT_RESPONSE; FB I_EVENT_RE S PONS E ; SRAM 
_EVENT_RESPONSE; SDRAM _EVENT_RESPONSE ; and ASB 
_EVENT_RESPONSE) from each one of the shared resources, 
e.g./ SRAM 26a, SDRAM 26b, or processor core 20, control 
and status registers, and so forth. These messages 
provide information on whether a requested function has 
completed. Based on whether or not a function requested 
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by a thread has completed and signaled completion, the 
thread needs to wait for that completion signal, and if 
the thread is enabled to operate, then the thread is 
placed on an available thread list (not shown) . The 
MicroEngine 22f can have a maximum of e.g., 4 threads 
available . 

In addition to event signals that are local to 
an executing thread, the MicroEngines 22 employ signaling 
states that are global. With signaling states, an 
executing thread can broadcast a signal state to all 
MicroEngines 22. Receive Request Available signal, Any 
and all threads in the MicroEngines can branch on these 
signaling states. These signaling states can be used to 
determine availability of a resource or whether a 
resource is due for servicing. 

The context event logic 74 has arbitration for 
the four (4) threads. In one embodiment, the arbitration 
is a round robin mechanism. Other techniques could be 
used including priority queuing or weighted fair queuing. 
The MicroEngine 22f also includes an execution box (EBOX) 
data path 76 that includes an arithmetic logic unit 76a 
and general -purpose register set 76b. The arithmetic 
logic unit 76a performs arithmetic and logical functions 
as well as shift functions. The registers set 76b has a 
relatively large number of general -purpose registers. As 
will be described in FIG. 6, in this implementation there 
are 64 general -purpose registers in a first bank, Bank A 
and 64 in a second bank, Bank B. The general -purpose 
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registers are windowed as will be described so that they 
are relatively and absolutely addressable. 

The MicroEngine 22f also includes a write 
transfer register 78 and a read transfer 80. These 
registers are also windowed so that they are relatively 
and absolutely addressable. Write transfer register 78 
is where write data to a resource is located. Similarly, 
read register 80 is for return data from a shared 
resource. Subsequent to or concurrent with data arrival, 
an event signal from the respective shared resource e.g., 
the SRAM controller 26a, SDRAM controller 26b or core 
processor 20 will be provided to context event arbiter 74 
which will then alert the thread that the data is 
available or has been sent. Both transfer register banks 
78 and 80 are connected to the execution box (EBOX) 76 
through a data path. In one implementation, the read 
transfer register has 64 registers and the write transfer 
register has 64 registers. 

Referring to FIG. 3, processor 12 has processing 
threads 41 and 42 executing in MicroEngines 22a and 22b 
respectively. In other instances, the threads 41 and 42 
may be executed on the same MicroEngine. The processing 
threads may or may not share data between them. For 
example, in Fig. 3, processing thread 41 receives data 43 
and processes it to produce data 44 . Processing thread 
42 receives and possesses the data 44 to produce output 
data 45. Threads 41 and 42 are concurrently active. 
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Because the MicroEngines 22a and 22b share SDRAM 16a 
and SRAM 16b (memory) , one MicroEngines 22a may need to 
designate sections of memory for its exclusive use. To 
facilitate efficient allocation of memory sections, the 
SDRAM memory is divided into memory segments, referred to 
as buffers. The memory locations in a buffer share a 
common address prefix, or pointer. The pointer is used 
by the processor as an identifier for a buffer. 

Pointers to buffers that are not currently in use by 
a processing thread are managed by pushing the pointers 
onto a free memory stack. A thread can allocate a buffer 
for use by the thread by popping a pointer off the stack, 
and using the pointer to access the corresponding buffer. 
When a processing thread no longer needs a buffer that is 
allocated to the processing thread, the thread pushes the 
pointer to the buffer onto the stack to make the buffer 
available to other threads. 

The threads 41 and 42 have processor instruction 
sets 46, 47 that respectively include a "PUSH" 46a and a 
"POP" 47A instruction. Upon executing either the 
"PUSH" or the "POP" instruction, the instruction is 
transmitted to a logical stack module 56 (FIG. 4). 

Referring to Fig. 4, a section of the processor 9 
and SRAM 16b provide the logical stack module 56. The 
logical stack module is implemented as a linked list of 
SRAM addresses. Each SRAM address on the linked list 
contains the address of the next item on the list. As a 
result, if you have the address of the first item on the 
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list, you can read the contents of that address to find 
the address of the next item on the list, and so on. 
Additionally, each address on the linked list is 
associated with a corresponding memory buffer. Thus the 
stack module 56 is used to implement a linked list of 
memory buffers. While in use, the linked list allows the 
stack to increase or decrease in size as needed. 

The stack module 56 includes control logic 51 on the 
SRAM unit 26b. The control logic 51 performs the 
necessary operations on the stack while SRAM 16b stores 
the contents of the stack. One of SRAM registers 50 is 
used to store the address of the first SRAM location on 
the stack. The address is also a pointer to the first 
buffer on the stack. 

Although the different components of the stack 
module 56 and the threads will be explained using an 
example that uses hardware threads and stack modules, the 
stack can also be implemented in operating system 
software threads using software modules. Thread 41 and 
thread 42 may be implemented as two operating system 
threads which execute 1X PUSH" and "POP" operating 
system commands to allocate memory from a shared memory 
pool. The operating system commands may include calls to 
a library of functions written in the %% C" programming 
language. In the operating system example, the 
equivalents of the control logic 51, the SRAM registers 
50 and SRAM 16B are implemented using software within the 
operating system. The software may be stored in a hard 
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disk, a floppy disk, computer memory, or other computer 
readable medium. 

Referring to FIG. 5A, SRAM register Ql stores an 
address (0xC5) of the first item on the stack 60. The 
SRAM location (0xC5) of the first item on the stack 60 is 
used to store the SRAM address (OxAl) of the second item 
on the stack 60. The SRAM location (OxAl) of the second 
item on the stack 60 is used to store the address of the 
third item on the stack 60, etc. The SRAM location 
(0xE9) of the last item on the stack stores a pre- 
determined invalid address (0x00) , which indicates the 
end of the linked list. 

Additionally, the addresses of the items (0xC5, 
OxAl, and 0xE9) on the stack 60 are pointers to stack 
buffers 61a, 61b, 61c contained within SDRAM 16A. A 
pointer to a buffer is pushed onto the stack by thread 
41, so that the buffer is available for use by other 
processing threads. A buffer is popped by thread 42 to 
allocate the buffer for use by thread 42. The pointers 
are used as an address base to access memory locations in 
the buffers. 

In addition to stack buffers 61a-c, SDRAM 16A also 
contains processing buffer 62, which is allocated to 
thread 41. The pointer to processing buffer 62 is not on 
the stack because it is not available for allocation by 
other threads. Thread 41 may later push a pointer to the 
processing buffer 62 onto the stack when it no longer 
needs the buffer 62. * "* ' ' 
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Although the stack will be discussed with reference 
to the buffer management scheme above, it can be used 
without buffers. Referring to Fig. 5B, the SRAM 
locations 0xC5, OxAl, and 0xE9 may, respectively, contain 
5 data 70a, 70b, and 70c in addition to an address to the 

next item on the list. Such a scheme may be used to 
store smaller units of data 70a- c on the stack. In such 
a scheme, the control logic would assign a memory 
location within the SRAM for storing the unit of data 

10 (datum) that is to be pushed onto the stack. The datum 

pushed onto the stack may be text, numerical data, or 
even an address or pointer to another memory location. 

Referring to FIG. 6A, to pop a datum off the stack 
stored in SRAM register Ql, thread 42 executes 101 the 

15 instruction "POP #1". The pop instruction is part of 

the instruction set of the MicroEngines 22 . The pop 
instruction is transmitted to control logic 51 over bus 
55 for stack processing. Control logic 51 decodes 102 
the pop instruction. The control logic also determines 

20 103 the register that contains a pointer to the stack 

that is referred to in the instruction based on the 
argument of the pop instruction. Since the argument to 
the pop instruction is "#1", the corresponding register 
is Ql. The control logic 51 returns 104 the contents of 

25 the Ql register to the context of processing thread 42. 

The stack of FIG. 5A would return "0xC5". Processing 
thread 42 receives 107 the contents of the Ql register, 
which is "0xC5", and uses 108 the received content to 
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access data from the corresponding stack buffer 61b by 
appending a suffix to the content. 

Control logic 27 reads 105 the content (OxAl) of the 
address (0xC5) stored in the Ql register. Control logic 
5 27 stores 106 the read content (OxAl) in the Ql register 

to indicate that the 0xC5 has been removed from the stack 
and OxAl is now the item at the top of the stack. 

Referring to Fig. 6B, the state of the stack after 
the operations of FIG. 6A will be described. As shown, 

10 the register Ql now contains the address OxAl, which was 

previously the address of the second item on the stack. 
Additionally, the location that was previously stack 
buffer 61b (in FIG. 5A) is now processing buffer 65, . 
which is used by thread 42. Thus, thread 42 has removed 

15 stack buffer 61b from the stack 60 and allocated the 

buffer 61b for its own use. 

Referring to Fig. 7A, the process of adding a 
buffer to the stack will be described. Thread 41 pushes 
processing buffer 62 (shown in FIG. 6B) onto the stack by 

20 executing 201 the instruction "PUSH #1 0x01". The 

argument 0x01 is a pointer to the buffer 62 because it is 
a prefix that is common to the address space of the 
locations in the buffer. The push instruction is 
transmitted to control logic 51 over the bus 55. 

25 Upon receiving the push instruction, the control 

logic 51 decodes 202 the instruction and determines 203 
the SRAM register corresponding to the instruction, based 
on the second 'argument of the push instruction. Since 
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the second argument is * % #1" , the corresponding register 
is Ql. The control logic 51 determines the address to be 
pushed from the third argument (0x01) of the push 
instruction. The control logic determines 205 the 
content of the Ql register by reading the value of the 
register location. The value OxAl is the content of the 
Ql register in the stack of FIG. 6B. The control logic 
stores 2 06 the content (OxAl) of the Ql register in the 
SRAM location whose address is the push address (0x01) . 
The control logic then stores 207 the push address (0x01) 
in the Ql register. 

Referring to FIG. 7B, the contents of the stack 
after the operations of FIG. 7A will be described. As 
shown, the SRAM register Ql, contains the address of the 
first location on the stack, which is now 0x01. The 
address of the first location on the stack is also the 
address of stack buffer 61d, which was previously a 
processing buffer 62 used by thread 41. The location 
OxAl, which was previously the first item on the stack, 
is now the second item on the stack. Thus, thread 41 
adds stack buffer 61d onto the stack to make it available 
for allocation to other threads . Thread 42 can later 
allocate the stack buffer 6 Id for its own use by popping 
it off the stack, as previously described for FIG. 6A. 

Referring to Fig. 8, a second stack 60b (shown in 
phantom) may be implemented in the same stack module by 
using a second SRAM control register to store the address 
of the first element in the second stack 60b. The second 
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stack may be used to manage a separate set of memory 
buffers, for example, within SRAM 16b or SDRAM 16a. A 
first stack 60a has the address of the first element on 
the stack 60a stored in SRAM register Ql . Additionally, 
5 a second stack 60b has the address of its first element 

stored in register Q6 . The first stack 60a is identical 
to the stack 60 in Fig. 7B. The second stack 60b is 
similar to previously described stacks. 

Other embodiments are within the scope of the 

10 following claims. Although the stack 60 (shown in FIG. 

5A) stores the pointer to the first element in a register 
Ql, the linked list in SRAM 16B and the buffers in SDRAM 
16A, any of the stack module elements could be stored in 
any memory location. For example, they could all be 

15 stored in SRAM 16b or SDRAM 16a. 

Other embodiments my implement the stack in a 
continuous address space, instead of using a linked list. 
The size of the buffers may be varied by using pointers 
(address prefixes) of varying length. For example, a 

20 short pointer is a prefix to more addresses and is, 

therefore, a pointer to a larger address buffer. 

Alternatively, the stack may be used to manage 
resources other than buffers. One possible application 
of the stack might be to store pointers to the contexts 

25 of active threads that are not currently operating. When 

MicroEngine 22a temporarily sets aside a first active 
thread to process a second active thread, it stores the 
context of the first active thread in a memory buffer and 
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pushes a pointer to that buffer on the stack. Any 
MicroEngine can resume the processing of the first active 
thread by popping the pointer to memory buffer containing 
the context of the first thread and loading that context . 
Thus the stack can be used to manage the processing of 
multiple concurrent active threads by multiple processing 
engines . 
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What is claimed is: 

1 1. A method comprising: 

2 pushing a datum onto a stack by a first processing 

3 thread; and 

4 popping the datum off the stack by a second 

5 processing thread. 

1 2. The method of claim 1 wherein the pushing 

2 comprises : 

3 executing a push command on the first processing 

4 thread, the push command having at least one argument, 

5 determining a pointer to a current stack datum, 

6 determining a location associated with an argument 

7 of the push command, 

8 storing the determined pointer at the determined 

9 location, 

10 producing a pointer associated with determined 

11 location the pointer to the current stack datum. 

1 3 . The method of claim 2 wherein determining a 

2 location comprises: 

3 decoding the push command. 

1 4 . The method of claim 2 wherein determining a 

2 location comprises: 

3 storing an argument of the pop command in a location 

4 associated with the argument of the push command. 
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1 5. The method oz claim 2 wherein said push command 

2 is at least one of a processor instruction, and an 

3 operating system call. 

1 6. The method of claim 1 wherein popping 

2 comprises: 

3 executing a pop command by the second processing 

4 thread, 

5 determining a pointer to a current stack datum, 

6 returning the determined pointer to the second 

7 processing thread, 

8 retrieving a pointer to a previous stack datum from 

9 a location associated with the pointer to the current 

10 stack datum, and 

11 assigning the retrieved pointer the pointer to the 

12 current stack datum. 

1 7. The method of claim 6 wherein the location 

2 associated with the pointer to the current stack datum is 

3 the location that has an address equal to the value of 

4 the pointer to the current stack datum. 

1 8. The method of claim 6 wherein the location 

2 associated with the pointer to the current stack datum is 

3 the location that has an address equal to the sum of an 

4 offset and the value of the pointer to the current stack 

5 datum. 
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1 9. The method of claim 6 wherein the pop command 

2 is at least one of a processor instruction or an 

3 operating system call . 

1 10. The method of claim 1 further comprising: 

2 storing data in a memory buffer that is accessible 

3 using a buffer pointer having the datum that is pushed 

4 onto the stack. 

1 11. The method of claim 1 further comprising: 

2 using the popped datum as a buffer pointer to access 

3 information stored in a memory buffer. 

1 12. The method of claim 1 further comprising: 

2 a third processing thread pushing a second datum 

3 onto the stack. 

1 13. The method of claim 1 further comprising: 

2 a third processing thread popping a second datum of 

3 the stack. 

1 14 . A system comprising: 

2 a stack module that stores data by pushing it onto 

3 the stack and processing threads can retrieve information 

4 by popping the information off the stack, 

5 a first processing thread having a first command 

6 set, including at least one command for pushing data onto 

7 the stack, and 

8 a second processing thread having a second command 
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9 set, including at least one command for popping the data 

10 off the stack. 

1 15. The system of claim 14 wherein the first and 

2 second processing threads are executed on a single 

3 processing engine. 

1 16. The system of claim 14 wherein the first and 

2 second processing threads are executed on separate 

3 processing engines. 

1 17. The system of claim 16 wherein the separate 

2 processing engines are implemented on the same integrated 

3 circuit. 

1 18. The system of claim 14 wherein the stack module 

2 and the processing threads are on the same integrated 

3 circuit. 

1 19 . The system of claim 14 where the first and 

2 second command sets are at least one of a processor 

3 instruction set and an operating system instruction set. 

1 20. The system of claim 14 further comprising a bus 

2 interface for communicating between at least one of the 

3 processing threads and the stack module. 

1 21. A stack module comprising: 

2 control logic that responds to commands from at 

3 least two processing threads, the control logic storing 

4 datum on a stack structure in response to a push command 
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5 and retrieving datum from the stack in response to a pop 

6 command. 

1 22. The stack module of claim 21 further comprising 

2 a stack pointer associated with the most recently stored 

3 datum on the stack. 

1 23. The stack module of claim 22 further comprising 

2 a memory location associated with a first datum on the 

3 stack, the second memory location including: 

4 a pointer associated with a second datum which was 

5 stored on the stack prior to said first datum. 

1 24. The stack module of claim 22 further comprising 

2 a second stack pointer associated with the most recently 

3 stored datum on a second stack. 

1 25. The stack module of claim 22 wherein the stack 

2 pointer is a register on a processor. 

1 26. The stack module of claim 23 wherein said 

2 memory location includes SRAM memory. 

1 27. The stack module of claim 21 wherein the 

2 commands are processor instructions. 

1 28. The stack module of claim 21 wherein the 

2 commands are operating system instructions. 

1 29. An article comprising a* computer-readable 

2 medium which stores computer logic, the computer logic 

3 comprising: 
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a stack module configured to store data from a first 
processing thread by pashing the data onto a stack and to 
retrieve the data for a second processing thread by 
popping the data off the stack, the stack module being 
responsive to a first processing thread command to store 
data on the stack and a second processing thread command 
to retrieve data from the stack. 

30. An article comprising a computer- readable 
medium which stores computer-executable instructions, the 
instructions causing a processor to: 

store data from a first processing thread by 
executing an instruction to push the data onto the stack; 
and 

retrieve the data for a second processing thread by 
executing an instruction to pop the data from the stack 
for use by the second thread. 
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